Exploring semantic cueing effects using Mcgurk fusion

نویسنده

  • Azra Nahid Ali
چکیده

In this paper highlights that audiovisual speech perception is not all autonomous and that lexical semantic context and word meaning can influence McGurk fusion and the rate of fusion responses too. Sentence context can actually diminish McGurk fusion rate when semantic cueing from the context biases against the fusion expected. However, it did not block the fusion entirely even when the cue strongly favoured the audio or visual channel. Probabilistic grammars were used to measure the strength and directionality of speech cueing effects, using conditional probabilities estimated from relative frequencies in the British National Corpus. Results from conditional probabilities showed that the greater the strength of the semantic bias the greater the reduction in fusion rate. Whereas, positive semantic cueing examples of Sharma (1989) showing an increase in fusion rates when the phrase favoured the expected fusion. Audiovisual speech perception can be influenced by the semantic context which adds to evidence from other types of experiment that speech perception is not all bottom-up processing.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Integration of audiovisual speech and priming effects

Humans report fusion /da/ when presented with audio /ba/ aligned with visual /ga/. Over the last three decades most researchers have neglected the velar McGurk fusion: audio /ba/ with visual /da/ eliciting /ga/ fusion, and audio /pa/ with visual /ta/ resulting in /ka/ fusion. Cathiard [1], claimed that these latter types of fusion are laboratory curiosities which do not occur embedded in French...

متن کامل

Disentangling unisensory from fusion effects in the attentional modulation of Mcgurk effects: a Bayesian modeling study suggests that fusion is attention-dependent

The McGurk effect has been shown to be modulated by attention. However, it remains unclear whether attentional effects are due to changes in unisensory processing or in the fusion mechanism. In this paper, we used published experimental data showing that distraction of visual attention weakens the McGurk effect, to fit either the Fuzzy Logical Model of Perception (FLMP) in which the fusion mech...

متن کامل

Cross-Modal Fusion: Context Effects in Lexical Words

The study focuses on the response of participants to audiovisual presentations of talking heads, and examines the effect of noise and temporal misalignment of channels in English monosyllabic words. The results show that McGurk fusion of phonetic segments is sensitive to the linguistic context of a segment: coda consonants elicit fusion more frequently than onset consonants and short vowels eli...

متن کامل

McGurk fusion effects in Arabic words

Our earlier work, on incongruent audiovisual segments embedded in English wordand phrasestimuli, showed that McGurk fusion is sensitive to the phonological context of a segment. In this paper we describe the preparation and early testing of Arabic word stimuli with an incongruent phonetic segment. We confirm that in the context of Arabic words, fusion similar to that in English words still occu...

متن کامل

Role of form and motion information in auditory-visual speech perception of Mcgurk combinations and fusions

The perception of biological motion is influenced by motion and form information. Point-light technique has been used to capture the kinematic properties of biological motion. Integration of auditory-visual information in speech perception has been shown to be influenced by such degraded forms of display. The present experiment investigates the role of global shape information and motion in mul...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2007